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Abstract 

Background: Walking for physical activity is associated with substantial health benefits for adults. Increasingly 
research has focused on associations between walking behaviours and neighbourhood environments including 
street characteristics such as pavement availability and aesthetics. Nevertheless, objective assessment of street-level 
data is challenging. This research investigates the reliability of a new street characteristic audit tool designed for use 
with Google Street View, and assesses levels of agreement between computer-based and on-site auditing. 

Methods: The Forty Area STudy street VIEW (FASTVIEW) tool, a Google Street View based audit tool, was developed 
incorporating nine categories of street characteristics. Using the tool, desk-based audits were conducted by trained 
researchers across one large UK town during 201 1. Both inter and intra-rater reliability were assessed. On-site street 
audits were also completed to test the criterion validity of the method. All reliability scores were assessed by 
percentage agreement and the kappa statistic. 

Results: Within-rater agreement was high for each category of street characteristic (range: 66.7%-90.0%) and good 
to high between raters (range: 51.3%-89.1%). A high level of agreement was found between the Google Street View 
audits and those conducted in-person across the nine categories examined (range: 75.0%-96.7%). 

Conclusion: The audit tool was found to provide a reliable and valid measure of street characteristics. The use of 
Google Street View to capture street characteristic data is recommended as an efficient method that could 
substantially increase potential for large-scale objective data collection. 
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Introduction 

Walking is widely promoted as an effective form of 
physical activity associated with wide ranging health 
benefits for adults [1]. Current UK guidelines recom- 
mend that adults complete at least 150 minutes of mod- 
erate intensity activity, such as brisk walking, every week 
[2]. Nevertheless, the English National Travel Survey 
2010 reports that walking trips have declined by 28% 
since 1995 [3]. 

Ecological models of health behaviour suggest that 
environments such as residential neighbourhoods can 
directly influence physical activity behaviours including 
walking [4], However, the objective measurement of 
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environmental variables provides a substantial research 
challenge. Mapping technologies, such as Geographical 
Information Systems (GIS), have increased access to ob- 
jectively characterised data on neighbourhood design 
and land-use. These data are now regularly utilised in 
physical activity research and significant associations 
have been found between walking behaviours and land- 
use mix, population density and destination proximity 
[5]. Detailed street-level characteristics such as pavement 
quality, lighting and aesthetics may additionally be influ- 
ential. Indeed, walking for both travel and leisure have 
been significantly associated with individuals' percep- 
tions of the availability of pavements [6,7] and aesthetics 
[8]. Objectively measured street-level data, however, are 
rarely available through mapping databases [9]. 
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A number of street audit tools such as the Systematic 
Pedestrian And Cycling Environment Scan tool 
SPACES [10], the Pedestrian Environment Review Sys- 
tem (www.trl.co.uk) and the Residential Environment 
Assessment Tool REAT [11] are available to measure 
the street characteristics hypothesised to influence 
walking behaviours. Such audit tools are completed in- 
person by trained researchers and are typically found 
to provide a valid and reliable measure [10,11]. How- 
ever, in-person audits are highly time-consuming, have 
safety issues for personnel and are costly due to the re- 
lated travel expenditure, thus prohibiting large-scale 
data collection for the majority of research projects. 
Recent technological advancements, such as the Goo- 
gle Street View programme (www.google.com/maps), 
might provide an alternative mechanism to traditional 
in-person street auditing. Google Street View is a freely 
available web service using video stills of streets and 
neighbourhoods captured worldwide. The images are 
displayed to provide continuous panoramic street 
views that can be navigated along and rotated by 360° 
allowing the user to virtually walk down any available 
street from their computer. The use of this desk-based 
tool, therefore, has the potential to dramatically reduce 
the resources necessary to complete large-scale assess- 
ment of street characteristics. 

The reliability of desk-based auditing has previously 
been investigated by a small number of studies all of 
which consistently report high levels of agreement be- 
tween Google Street View and in-person measures 
[12-14]. Nevertheless, to date, the majority of this re- 
search has focused on somewhat homogenous urban 
areas within the US. Further research is therefore neces- 
sary to assess the appropriateness of Google Street View 
in differing countries and area types where factors such 
as varying road and pavement width or traffic and build- 
ing density could potentially impact upon the reliability 
of the measurement tool. 

This study aims to first, test the inter-rater and intra- 
rater reliability of a newly developed street audit tool 
designed specifically for use with Google Street View 
and, second, to test the reliability of this desk-based 
measure when compared with on-foot street audits 
across a range of land-use types within the UK. This 
research forms part of the FAST study (Forty Area 
STudy). FAST is examining the degree to which built 
environment characteristics influence adults physical 
activity behaviours across a broad range of social and 
environmental settings in northwest England. In FAST, 
we are particularly interested in capturing aspects of 
the street environment around our participants' homes 
that may influence their walking and cycling behav- 
iours, and the street audit tool that we present in this 
paper, was developed for this purpose. 



Methods 

Street audit tool development 

The FASTVIEW audit tool was created in collaboration 
with the UK Transport Research Laboratory (TRL). The 
audit tool was based on the Pedestrian Environment Re- 
view System (PERS) initially designed by TRL to identify 
target areas for improving pedestrian access within 
London and the rest of the UK (www.trl.co.uk). PERS 
and FASTVIEW have different aims and therefore modi- 
fications to the original PERS were made to reduce the 
subjective elements of the tool and to take into account 
current academic evidence and the expert opinion of the 
FAST steering committee. For example, an assessment 
of the housing design and 'feel' of a street was replaced 
with an assessment of housing and street maintenance 
where auditors were asked to assess factors such as 
levels of graffiti and litter. The final FASTVIEW tool in- 
corporated nine categories of neighbourhood character- 
istics (e.g. pavement quality, lighting and safety) with 
each category including up to three separate factors (e.g. 
pavement width and spacing of street lights) as displayed 
in Table 1. Each factor had a number of levels that it 
was rated on. In Table 1 the levels are listed in the third 
column and are ordered from more positive through to 
more negative (researchers wanting access to the tool 
should contact the corresponding author). 

A data input form was created using Microsoft Access 
with drop down menu options for all responses. The 
form was designed to be viewed alongside Google Street 
View using a computer split screen (Figure 1). Prior to 
data collection all auditors completed a one-day training 
course with an experienced auditor from TRL and were 
provided with a detailed user manual for reference dur- 
ing auditing. For each link both sides of the road were 
audited. When a road had a pavement on one side only 
the side with the pavement was audited. For pavement 
width and street lighting spacing the distance measure- 
ment tool in Google Street View was used. A guideline 
of 10-15 minutes completion time was suggested for 
each street audit. Both Google Street View and on-street 
audits took approximately 10 minutes to complete. 

Sampling 

Wigan, a large UK town in the North West of England 
was chosen to test the reliability of the FASTVIEW audit 
tool due to the large diversity of land-use types (includ- 
ing housing, shopping, parkland and industrial areas) 
close to the town centre. The population weighted cen- 
troid for the town was located using a Geographical In- 
formation System (GIS) and the audit area was defined 
by an 800 m radius (approximately a 10 minute walk) 
around this centre point (Figure 2). The road network 
within the study area was mapped in the GIS and di- 
vided into road sections termed links'. Where possible 
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Table 1 Walkability categories within the audit tool 



Category 


Factors 


Levels 


Pavement width and 
obstructions 


Pavement width (metres) 
Street furniture placement 


>3; 2—3; 1-2; <1; no pavement 
Aligned to side; poorly placed; N/A* 




Presence of cars parked on the pavement 


No cars on pavement; cars on pavement; N/A 


Pavement surface quality 


Pavement trip hazards 


No obvious trip hazards; some trip hazards; N/A 




Pavement surface consistency 


Consistent; inconsistent; N/A 




Reinstatements in pavement surface 


Not obvious; obvious; N/A 


Kerb paving quality 


Presence of tactile paving at kerbs 


All crossings; >50% of crossings; 50% of crossings; <50% of crossings; no 
tactile paving; N/A 




Presence of dropped kerbs 


All crossings; >50% of crossings; 50% of crossings; <50% of crossings; no 
dropped kerbs; N/A 


Road permeability 


Road width (metres) 


Pedestrianised street; shared surface street; <6; 6-10; >10 




Obstructions to crossing 


No guardrails or parked cars; <50%; 50%; >50% 




Availability of designated crossing points 


Quiet residential street; 2+ crossings; 1 crossing; no crossings; N/A 


Way finding and legibility 


Presence of street name signage 


All street names present; >50%; 50%; <50%; none 




Presence of other pedestrian signage 


Additional signage; no additional signage 




Presence of landmarks 


Landmarks; no landmarks 


Lighting 


Presence of street lighting 


Focussed on pavement; focussed on carriageway; no lighting 




Spacing of street lighting (metres) 


20-30; 30-50; >50; N/A 




Likelihood of overnight lighting from 
nearby buildings 


Shop fronts likely to provide light; not likely 


Personal security 


Evidence of vandalism or graffiti 


No evidence; some evidence 




Presence of closed circuit television 
surveillance 


Yes; No 




Informal ci i r\ /oi II a nr-o frnm noarh\/ hoi icinpi 
IlllUlllldl oUI Vcllldl ILc IIUIII llcdlUy IIUUolllLj 


Yes - No 


User conflict 


Obstruction from bus queues 


Yes; No 




Separation between cyclists and 
pedestrians 


Yes; No 




Presence of traffic calming measures 


Yes; No 


Environment quality 


Quality of housing 


High quality frontages; low quality frontages 




Presence of trees 


Yes; No 




Street maintenance 


Clean and well maintained; some litter; some litter and graffiti 



* N/A, Not Applicable because there was no pavement. 



these links stretched between road junctions, however in 
the case of long roads that had few junctions we aimed 
to maintain homogeneity within links by setting the 
maximum link length at 300 metres thus minimising the 
potential for links to straddle different land uses. Conse- 
quently long stretches of road were split into a series of 
links no longer than 300 metres in length. Similarly the 
minimum link length was set at 50 metres. A total of 
216 eligible audit links were identified within the study 
area, of these 25% (n = 54) were randomly selected for 
auditing based on recommendations [15]. The 54 links 
equated to 5.36 kilometres of road network. 

Data reduction and analysis 

Each street link was rated as 'good' (2), 'fair' (1) or poor' 
(0) in each of the nine walkability categories based on 



combined results from the associated factors. For ex- 
ample a street with wide pavements (>3 m), street furni- 
ture (e.g. benches and lighting) aligned to the side of the 
pavement, and with no cars parking on the pavement 
would get the highest score (2) in the pavement width 
and obstructions category (see Table 1). In general, if the 
levels of each category were consistently positive then 
the category would be rated as good and if they were 
consistently negative the category would be rated as 
poor. If the levels were neither consistently good nor 
poor then the category was rated as fair. 

The kappa statistic was chosen for the reliability ana- 
lysis as it provides a chance-corrected measure of agree- 
ment suitable for use with categorical data. However, 
a recognised limitation of the kappa statistic is that a 
low kappa co-efficient can be recorded despite high 
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Area ID: 34 Link ID: 3210 

Road name: Walmcrsley Road 

width and obstructions l-2m footway 

permeability 6- 10m carriageway 

surface quality of footway n ° 0t>v,0uS ?np h,?,rdS 
legibility and wayfindinf *» street names present 
lighting focus sed on carriageway 



Zone: 400 



Co-ordinates: 



S3.6073099798, 7.79084946111 



Comments: 



furniture aligned to side 
no guardrails or parked cars 
inconsistent surface type 
no additional pedestrian signage 
20- 30m apart 



no cars on pavement 
1 crossing 

reinstatements obvious 
no landmarks 



shop fronts unlikely to provide light over 



Figure 1 FASTVIEW audit tool. 



levels of observed agreement dependent upon the preva- 
lence of agreement [16]. Thus results here report and 
discuss the percentage of observed agreement in 
conjunction with the calculated kappa co-efficient. 
Kappa values were interpreted as follows: 0.01-0.20 
(slight agreement); 0.21-0.40 (fair agreement); 0.41- 
0.60 (moderate agreement); 0.61-0.80 (substantial 
agreement); 0.81-0.99 (almost perfect agreement) [16]. 
Three reliability tests were conducted: inter-rater, 
intra-rater and criterion reliability. 



Intra-rater reliability 

To assess the level of agreement over repeated measures 
each auditor (n = 3) completed desk-based street audits 
using Google Street View for 20 randomly selected links 
on two separate occasions. Intra-rater reliability was 
assessed using Cohens' kappa statistic. 



Inter-rater reliability 

To assess the level of agreement between researchers all 
three auditors completed desk based street audits using 
Google Street View for all of the area links (n = 54). Inter- 
rater reliability was assessed using Fleiss kappa statistic. 

Criterion reliability 

To assess agreement between desk-based audits using 
Google Street View and in-person street audits, re- 
searchers carried out in-person audits for selectively 
sampled links (n = 30) encompassing a mix of land-use 
types. The auditing for the reliability study was part of 
a wider auditing study, with auditors auditing street 
links using both street view and on-foot visits. The on- 
foot audits could take place either before or after street 
view but were always within 6 months of each other. 
Auditors could not review their scores for one version 
of the audit prior to undertaking the other. Given the 



Griew et al. International Journal of Behavioral Nutrition and Physical Activity 2013, 10:103 
http://www.ijbnpa.org/content71 0/1 /1 03 



Page 5 of 7 



Inter- rater reliability results were high (average 71.7%) 
for the majority of street characteristics, however, in 
three categories (pavement quality, lighting, and road 
permeability) reliability results were low for both per- 
centage agreement (<60%) and the kappa co-efficient 
(<0.4). Additional detailed analysis revealed that inter- 
rater reliability varied substantially between land-use 
types with the lowest average agreement between audi- 
tors (60%) recorded in industrial estates and the highest 
average agreement (74%) attained in residential areas. 

Percent agreement between in-person and desk-based 
audits (criterion reliability) was high across all street 
characteristic categories with results ranging from 75 to 
97% agreement (average 84%) and the kappa co-efficient 
ranging from k = 0.5 to 0.9 (moderate to almost perfect). 

Discussion 

The FASTVIEW tool was found to provide a reliable 
measure of street characteristics considered likely to be 
associated with individual walking behaviours. It was 
found to provide a reliable measure of street characteris- 
tics reporting high percentage agreement and moderate 
kappa coefficients for levels of inter and intra-rater reli- 
ability over the majority of street characteristic categor- 
ies. Furthermore the use of Google Street View to 
complete street audits provided high levels of agreement 
between the desk-based and on-site audits. 

This new measure is therefore considered to provide a 
practical and reliable street audit tool. Nevertheless, for 
three of the nine street characteristic categories, agree- 
ment levels were found to be low between auditors. Pre- 
vious environment audit tools have often noted low 
levels of inter-rater reliability where variables require a 
judgement on quality or aesthetics [10,17]. Similarly the 
lowest inter-rater agreement here was reported for the 
pavement quality category. Furthermore, when assessed 
in greater detail, inter-rater reliability was found to vary 
substantially between land-use types, with the lowest 
agreement found within industrial estates. Raters had 



Table 2 Reliability scores 



Category 


Inter-rater reliability 


Intra-rater reliability 


Criterion reliability 


% Agreement 


K 


% Agreement 


K 


% Agreement 


K 


Pavement width and obstructions 


88.5 


0.597 


83.3 


0.44 


85.0 


0.69 


Pavement surface quality 


51.3 


-0.009 


70.0 


0.48 


83.3 


0.73 


Kerb paving quality 


82.7 


0.373 


86.7 


0.45 


75.0 


0.55 


Road permeability 


58.3 


0.143 


73.3 


0.48 


86.7 


0.73 


Way finding and legibility 


71.8 


0.313 


86.7 


0.66 


76.7 


0.50 


Lighting 


57.7 


-0.075 


86.7 


0.60 


78.3 


0.61 


Personal security 


79.5 


0.445 


86.7 


0.42 


88.3 


0.64 


User conflict 


89.1 


0.451 


90.0 


-0.05 


96.7 


0.90 


Environment quality 


66.7 


0.232 


66.7 


0.30 


86.7 


0.62 




Figure 2 Street network 800 m buffer zone. 



large number of links, it is extremely unlikely that 
these scores would be recalled. Criterion reliability was 
assessed using Cohens' kappa statistic. 
All reliability tests were run using STATA version 12. 

Results 

Reliability test results are displayed in Table 2. The 
FASTVIEW tool was found to provide fair to moderate 
inter and intra-rater reliability over the majority of street 
characteristic categories and substantial agreement was 
reported between desk-based audits using Google Street 
View and those conducted in-person. 

Intra-rater reliability results were high for all street 
characteristics, with an average of 81% (k = 0.4) agree- 
ment between the first and second audit. The 'fair' kappa 
co-efficient can largely be explained by results from the 
user conflict category where a result of k = -0.05 was 
returned despite 90% agreement between measures. 
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difficulty agreeing on the quality of frontages in indus- 
trial areas and whether industrial buildings would 
provide overnight lighting. Further refinement of the 
training procedure and guidance manual, in particular 
focusing on a range of different land-use areas, may be 
beneficial to ensure high agreement between auditors 
across all categories. 

Findings from this study indicate that desk-based au- 
dits using Google Street View provide an effective and 
reliable alternative to in-person street audits within the 
UK, with similarly high levels of reliability as those 
recorded in urban areas of the US [13,14]. This conclu- 
sion is important as desk-based auditing can provide 
many substantial benefits. Most notably the time and 
costs of objective street auditing are substantially dimin- 
ished. Indeed trained auditors can now complete large- 
scale street characteristic research from a single location. 
Objective analysis is therefore achievable for the major- 
ity of research projects, vastly improving the potential 
for analysis across diverse areas within countries and 
internationally. Additional benefits of this method in- 
clude supportive technology such as the distance meas- 
urement tool available in Google Street View enabling 
accurate assessment of variables such as pavement width 
and street light spacing, which can be difficult to capture 
in-person, and the removal of any potential lone auditor 
safety concerns. 

Strengths and limitations 

During the auditing process a number of limitations in 
the use of Google Street View were identified. First, the 
view from the Google Street View cameras differs to that 
of a pedestrian auditor, pictures are provided from the 
centre of the road rather than the pavement, thus, block- 
ages such as parked cars or road works can obstruct 
views of specific variables on some streets, in particular, 
pavement quality and signage. Furthermore, image 
clarity varied dependent upon the weather conditions 
and lighting when images were taken, and the vehicles 
used to collect images may not be able to access 
pedestrianized streets, a particular problem for many 
city centre audits across the UK. Second, the temporality 
of Street View can be problematic. For example, results 
in some categories (e.g. the number of parked cars) may 
vary throughout the day, but the time when images were 
taken is not provided by the system. Similarly, although 
street auditing may be undertaken in conjunction with 
physical activity assessment, a substantial time lapse may 
have occurred since pictures were obtained for Street 
View images, thus the possibility that changes in street 
conditions may have occurred between measures cannot 
be ruled-out. Nevertheless the ease, speed, low associ- 
ated costs and high criterion reliability of desk-based 



auditing are argued to considerably out-weigh these 
limitations. 

This study provides comprehensive reliability testing 
of a new audit tool designed specifically for desk-based 
auditing and the suitability of the measure was tested. 
One large UK town was chosen for auditing purposes 
and, following previous recommendations [15], 25% of 
all possible street links were included in the measure for 
both inter-rater and intra-rater reliability tests. Previous 
research assessing the reliability of Google Street View 
to measure street characteristics has largely focused on 
urban environments in the US [13,14], this study there- 
fore adds to current research providing results specific 
to the UK and across a range of land-use types. How- 
ever, a limitation of the study is that, due to resource re- 
strictions, just 30 street links were audited in-person 
providing a relatively small sample for criterion reliabil- 
ity analysis. In addition this study did not assess the 
reliability of the FASTVIEW tool within rural areas of 
the country. 

This research was conducted as part of the wider 
FAST study measuring environmental associations with 
adults physical activity. Further analysis is necessary to 
assess associations between street characteristics, mea- 
sured using the FASTVIEW audit tool, and self-reported 
walking behaviours and objectively measured physical 
activity. Further, the value of street audit measures for 
discriminating walking behaviours over macro level 
neighbourhood measures, derived from GIS, requires 
additional analysis. 

Conclusion 

The FASTVIEW audit tool provides a reliable, easy to 
use, and appropriate tool for the objective measurement 
of street characteristics over a range of differing land-use 
types and is, therefore, recommended for future large- 
scale street auditing. 
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